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SYSTEM AND METHOD FOR PROVIDING IMAGES FOR AN OPERATOR 
OF A VEHICLE 



TECHNICAL FIELD OF THE INVENTION 

This invention relates in general to optical 
systems, and, more particularly, to a system and method 
for providing images for an operator of a vehicle. 
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BACKGROUND OF THE INVENTION 

During daylight hours, the driver of a vehicle is 
able to detect and recognize objects that would be 
difficult, if not impossible, to detect or recognize at 
night. For example, on a sunny day, a deer approximately 
500 meters ahead of a vehicle should be readily 
detectable and recognizable. At night, however, 

particularly when the headlights provide the only 
illumination, the deer will not be detectable, much less 
recognizable, at that distance because it will be beyond 
the range of the headlights. Moreover, by the time the 
driver detects the deer, and well before recognizing what 
it is, the vehicle will be much closer to the deer than 
during daylight. Accordingly, the risk of a resulting 
accident is much higher at night than during the day. 

Consequently, in order reduce the risk of accidents, 
night vision systems have been developed to supplement 
the driver's vision. Typical night vision systems 

include an infrared camera unit mounted in the grill of 
the vehicle and an image source mounted in the vehicle's 
dashboard. The camera unit gathers information regarding 
the scene in front of the vehicle, and the image source 
projects an image derived from the information onto the 
windshield for display. 

Using the windshield for image display, however, has 
several drawbacks. For example, the illumination of the 
image may be poor because a large amount of light is lost 
due to refraction. As another example, the image may be 
distorted because of the windshield's varying curvature. 



DAL01:648107.1 



ATTORNEY'S DOCKET 
019469.0224 



PATENT APPLICATION 



3 

To address these drawbacks, several night vision 
systems are proposing to use a magnifying optical element 
mounted to the dashboard as the combiner. Because of 
vision and aesthetic considerations, however, there is a 
continuing demand to reduce the size of the combiner. 
Moreover, if the combiner is to retract into the 
dashboard when not in use, additional sizing concerns may 
come into play. Unfortunately, reducing the size of the 
combiner usually decreases the f ield-of -view that may be 
presented to the operator of the vehicle. 
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SUMMARY OF THE INVENTION 

In accordance with the present invention, at least 
some of the disadvantages and problems associated with 
previous systems and methods for providing images for an 
operator of a vehicle have been substantially reduced or 
eliminated. Accordingly, at least in particular 

embodiments, the invention provides a low-profile 
combiner for an image display system that has an 
acceptable f ield-of -view for the operator. 

In particular embodiments, a method for providing 
images for an operator of a vehicle includes receiving 
electrical signals representing electromagnetic radiation 
at an image source and generating a visual image based on 
the electrical signals. The method also includes 

reflecting different portions of the visual image with a 
magnifying optical element for presentation at different 
viewing locations, the visual image appearing as a 
virtual image, wherein at least one dimension of the 
visual image is larger than the magnifying optical 
element can use to present an image at one of the viewing 
locations . 

In certain embodiments, a system for providing 
images for an operator of a vehicle includes an image 
source and a magnifying optical element. The image 
source is operable to receive electrical signals 
representing electromagnetic radiation and to generate a 
visual image based on the electrical signals. The 
magnifying optical element is operable to reflect 
different portions of the visual image for presentation 
at different viewing locations, the visual image 
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appearing as a virtual image, wherein at least one 
dimension of the visual image is larger than the 
magnifying optical element can use to present an image at 
one of the viewing locations. 

The present invention has several technical 
features. For example, in some embodiments, the 

invention allows more of a visual image to be observed 
than the optical configuration will allow at one viewing 
location. Thus, an adequate view of the scene outside 
the vehicle may be achieved even when optical 
considerations do not allow complete viewing of the scene 
at one viewing location. As another example, in certain 
embodiments, the distracting features of the border 
effect are attenuated and/or distortions and/or 
aberrations caused by imperfections at the edge of the 
optics are reduced. As a further example, in particular 
embodiments, a combiner for the system may be reduced 
substantially in size while still allowing an operator to 
observe an adequate field. Thus, viewability and 

packaging constraints may be achieved. 

Of course, some embodiments may possess none, one, 
some, or all of these technical features and/or 
additional technical features. Other technical features 
will be readily apparent to those skilled in the art from 
the following figures, written description, and claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The figures described below provide a more complete 
understanding of the present invention and its technical 
features, especially when considered with the following 
detailed written description: 

FIGURE 1 is a diagrammatic view of a system for 
providing images for an operator of a vehicle in 
accordance with one embodiment of the present invention; 

FIGURES 2A-C provide side views of an unfolded 
representation of embodiments of the system in FIGURE 1; 

FIGURE 3 illustrates one aspect of the operation of 
the embodiments in FIGURES 2A-C; 

FIGURE 4 illustrates another embodiment of the 
system in FIGURE 1; 

FIGURE 5 illustrates still another embodiment of the 
system in FIGURE 1; and 

FIGURE 6 is a flowchart illustrating a method for 
providing images for an operator of a vehicle in 
accordance with one embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

FIGURE 1 is a diagrammatic view of a system 10 for 
providing images for an operator 3 0 of a vehicle 2 0 in 
accordance with one embodiment of the present invention. 
In general, system 10 includes an image source 50 located 
in a dashboard 22 of vehicle 20 and optics 60 located in 
and/or on dashboard 22. In particular embodiments, a 
windshield 24 of vehicle 2 0 may be used as part of system 
10. Image source 50 generates a visual image that, after 
encountering optics 60, and possibly windshield 24, is 
presented, in part, at a viewing location 70 for operator 
30. Note that the image presented at viewing location 70 
will probably appear as a virtual image 8 0 to operator 
30 . 

To generate the visual image, image source 50 
receives electrical signals representing the 
electromagnetic radiation collected by a radiation 
collector 40. Radiation collector 40 collects 

electromagnetic radiation within its f ield-of -view (FOV) , 
indicated by arrow 42. Note that, although not 

illustrated, radiation collector 40 also has a horizontal 
FOV. Accordingly, as illustrated, radiation collector 40 
is collecting electromagnetic radiation in front of 
vehicle 20. In other embodiments, however, radiation 
collector 4 0 may be used to collect electromagnetic 
radiation at any orientation relative to vehicle 20, such 
as, for example, rearward, which may be useful for 
backing situations. Note that, in certain embodiments, 
different orientations may be presented by system 10 at 
different times. 
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In operation, radiation collector 40 collects 
electromagnetic radiation emitted by objects within FOV 
42 and generates electrical signals that represent the 
electromagnetic radiation. Radiation collector 40 then 
communicates the electrical signals that represent the 
collected electromagnetic radiation to image source 50. 
Image source 50 processes the electrical signals to 
create a visual image that represents the collected 
electromagnetic radiation and then generates the visual 
image, represented by light rays 52. Light rays 52 
propagate through vehicle 2 0 and encounter optics 60, 
which manipulate and/or redirect a portion of rays 52 to 
viewing location 70, where operator 30 observes them, and 
hence part of the visual image. Manipulating light rays 
52 may include magnification, correcting for distortions, 
and/or applying any other appropriate optical effect. 

The components of system 10 may have a variety of 
forms. For example, vehicle 20 may be a car, a truck, or 
any other type of transportation device. As another 
example, image source 50 may be a liquid crystal display 
(LCD) , a gas -plasma display, or any other type of device 
that can produce a visual image. In particular 

embodiments, image source 50 includes a Sharp LQ025A3FR23 
LCD that is back-lit with a Cold Cathode Fluorescent Lamp 
(CCFL) tube. As a further example, optics 60 may include 
a reflector, a mirror, a lens, a beam splitter, a 
combiner, and/or any other type of device for 
manipulating and/or redirecting light. Moreover, if an 
embodiment includes a combiner, it may be 10 0% 
reflective, opaque, or clear. The optical elements may 
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be mounted in, on, and/or to dashboard 22 or any other 
appropriate portion of vehicle 20. As an additional 
example, radiation collector 40 may be a Mercury- Cadmium - 
Telluride photodetector , an Indium-Antimonide 

photodetector, an Indium-Gallium-Arsenide photodetector, 
a microbolometer (either dielectric or resistive) , a 
charge -coupled-device, or any other type of device that 
can detect electromagnetic radiation. In particular 
embodiments, the radiation collector is a Barium- 
Strontium-Titinate uncooled pyroelectric array. In 
certain embodiments, the radiation collector collects 
infrared radiation in the far infrared band, such as, for 
example, 8-12 microns, although any of a variety of other 
bands may be used, such as, for example, 3-5 microns (the 
mid-range infrared band), 0.8-2 microns (the near 
infrared band), or less than 0.8 microns (the visible 
band) . 

In particular embodiments, image source 50 and 
optics 60 are sized, spaced, and/or arranged so that the 
visual image produced by image source 50 is larger than 
the image that at least one element of optics 60 can use 
to present an image for operator 3 0 at viewing location 
70, resulting in a negative eyebox because not all of the 
visual image may be viewed at viewing location 70. 
Accordingly, operator 3 0 may have to use several head/eye 
positions to view all of virtual image 80. 

These embodiments have several technical features. 
For example, because more of a visual image may be viewed 
than optics 60 can produce at one viewing location, 
system 10 may provide an adequate view of the scene 
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outside vehicle 2 0 when optical considerations do not 
allow complete observation of the scene at one viewing 
location. For instance, assume that an image display has 
a magnifying optical element that acts as a combiner on 
dashboard 22 and that the system has a vertical FOV of 
3.3°, an eye to combiner distance of 500 mm, a vertical 
eyebox of 10 mm, a virtual image distance of 2,000 mm, an 
image source vertical aperture of 16.9 mm, and a combiner 
height of 55 mm. Enlarging the vertical aperture of the 
image source to 2 7 mm, which makes the combiner act 
essentially as the field stop for the system, provides a 
total vertical FOV of 5.28° to the operator upon using a 
variety of viewing locations. This amounts to a 60% 
increase in the total vertical FOV that may be observed 
by the operator. Moreover, the instantaneous vertical 
FOV is increased to 4°, which is a 21.2% increase over 
the relatively narrow 3.3° provided previously. Thus, 
enlarging the visual image provided by the image source 
beyond that which a combiner can use to present an image 
at a viewing location may allow a substantial increase in 
the instantaneous vertical FOV and the total vertical 
FOV. 

FIGURES 2A-C provide side views of an unfolded 
representation for the above discussed embodiments. As 
mentioned previously, in these embodiments, optics 60 
includes a magnifying optical element 62, which acts as a 
combiner, mounted to dashboard 22. Also, the system has 
a variety of viewing locations, represented by 70a-c. 
Note that viewing locations 70a-c may be part of an eye 
ellipse 74 - a representation of the horizontal and 
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vertical positions at which operators' eyes will be 
located for a particular vehicle. Various industry 
standard documents, such as, for example, SAE J941, 
entitled "Motor Vehicle Drivers' Eye Locations," may be 
used to define an eye ellipse for a vehicle. 

As can be seen in FIGURE 2A, the sizing, spacing, 
and/or arrangement of image source 50 and optical element 
62 allow the vertical dimension, represented by arrow 52, 
of the visual image generated by image source 50, and 
hence virtual image 80, to be larger than the image that 
optical element 62 can present at viewing location 70b. 
In effect, therefore, optical element 62 becomes the 
field stop for the system. 

Accordingly, the vertical FOV, represented by arrow 
68, that can be observed by operator 30 at viewing 
location 70b is smaller than the total vertical FOV, 
represented by arrow 82, produced by the combination of 
optical element 62 and image source 50. As operator 30 
adjusts her eye position to different viewing locations, 
however, other portions of virtual image 8 0 become 
observable . 

For example, if operator 30 adjusts eye position 
from viewing location 70b to viewing location 70a, as 
illustrated in FIGURE 2B, the lower portion of virtual 
image 8 0 becomes observable. Thus, operator 3 0 may view 
the lower portion of an object observed at viewing 
location 70b and/or view an object that was not 
observable at viewing location 70b by adjusting eye 
position to viewing location 70a. Note that while the 
instantaneous vertical FOV 68 at viewing location 70a is 



DAL01:648107.1 



ATTORNEY'S DOCKET 
019469.0224 



PATENT APPLICATION 



12 

slightly larger than the instantaneous vertical FOV 68 at 
viewing location 70b, this will not necessarily be true 
for all viewing locations in the operator's eye ellipse 
74 . 

As another example, if operator 3 0 adjusts eye 
position from viewing location 70b to viewing location 
70c, as illustrated in FIGURE 2C, the upper part of 
virtual image 8 0 becomes observable. Thus, operator 3 0 
may observe the upper portion of an object observed at 
viewing location 70b and/or observe an object that was 
not observable at viewing location 70b. Note again, that 
the instantaneous vertical FOV 68 at viewing location 70c 
is slightly larger than the instantaneous vertical FOV 68 
at viewing location 70b. 

It should be recognized that the spacing between 
viewing locations 70a-c has been exaggerated to 
illustrate the principles of the invention. Accordingly, 
in actual implementations, the spacing between viewing 
locations 70a-c will probably be on the order of 
approximately 2 0 to 4 0 mm. Furthermore, it should be 
recognized that there is a continuum of viewing locations 
between viewing locations 70a-c. Additionally, as 

mentioned previously, the instantaneous vertical FOV 68 
changes with the viewing location. Thus, for shorter 
and/or taller operators, the instantaneous vertical FOV 
presented by combiner 62 will vary. Accordingly, the 
height of varying operators may need to be taken into 
account when designing an image system in accordance with 
the present invention. In particular embodiments, this 
may be achieved by designing the system for a substantial 
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portion of the operator's eye ellipse, such as, for 
example, greater than 95%. 

FIGURE 3 illustrates the operation of optical 
element 62 relative to virtual image 80. As illustrated, 
virtual image 80 includes objects 81. Note that objects 
81 may be illustrated in more or less detail than may be 
observable in an actual implementation. At the current 
viewing location, such as, for example, viewing location 
7 0b, the top part of object 81c and the bottom part of 
object 81b are not observable. At a different viewing 
location, however, such as for example, viewing location 
70a, the bottom of object 81b may be observed. 
Additionally, at another viewing location, such as, for 
example, viewing location 70c, the top part of object 81c 
may be observed. Note that there may be a continuum of 
viewing locations at which different portions of virtual 
image 80 may be observed. 

FIGURE 3 also assists in demonstrating other 
technical features of these embodiments. As can be seen, 
because virtual image 8 0 is larger than the image that 
optical element 62 can use to present an image at one 
viewing location, the border between the visual image and 
the actual scene around optical element 62 is reduced. 
Thus, at least some distracting features of the border 
effect are lessened, at least for certain viewing 
locations. Additionally, distortions and/or aberrations 
caused by imperfections at the edge of optical element 62 
may be smoothed by having the image extend beyond the 
edge . 
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Note that the image presented by system 10 may or 
may not be minified relative to the image of the actual 
scene. Thus, a 4° FOV from the operator's perspective 
may actually represent 4° of actual scene or a much 
larger portion of the actual scene. Also note that other 
information may be presented in the visual image 
generated by image source 50 . 

Another technical feature of the invention is that, 
in certain embodiments, one or more elements of optics 60 
may be reduced in size and still allow adequate viewing 
of the scene outside vehicle 20, which reduces problems 
with driver visibility around or over the image display 
system and packaging within dashboard 22. For instance, 
assume again that an image display system has a 
magnifying optical element mounted to dashboard 22 that 
acts as a combiner and that has a vertical FOV of 4°, an 
eye to combiner distance of 500 mm, a vertical eyebox of 
20 mm, a virtual image distance of 2, 000 mm, and a 
combiner height of 49.92 mm. Reducing the combiner 
height to 33.21 mm (a reduction of approximately 33.47%) 
provides a 3.8° instantaneous vertical FOV with a total 
vertical FOV of 4°. Accordingly, while the instantaneous 
vertical FOV is reduced by only 5%, the total scene may 
still be observed. Thus, this feature may provide a 
significant improvement in packaging size while providing 
comparable FOV performance. 

FIGURE 4 illustrates another embodiment of system 
10. As illustrated, this embodiment includes image 
source 5 0 and a fold mirror 64 located within dashboard 
22. The embodiment also includes a magnifying optical 
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element 62 mounted to dashboard 22. As illustrated, 
magnifying optical element 62 is tilted, as indicated by 
arrow 63, approximately 15° from vertical, although other 
inclinations may be used in other embodiments. In 
particular embodiments, magnifying optical element 62 may 
retract within dashboard when not in use. 

In operation, image source 50 generates a visual 
image based on the information from an electromagnetic 
radiation collector, such as, for example, radiation 
collector 40. The visual image then propagates from 
image source 50 and encounters fold mirror 64, which 
redirects the visual image toward magnifying optical 
element 62. Upon encountering optical element 62, a 
portion of the visual image is directed toward a viewing 
location 70 for presentation. As discussed previously, 
different portions of the visual image may be viewed at 
different viewing locations. 

The embodiment illustrated in FIGURE 4 has several 
additional technical features. For example, using fold 
mirror 64 allows for an increased path length between 
image source 5 0 and magnifying optical element 62, which 
provides flexibility in the mechanical packaging of the 
image display. As another example, because the visual 
image from image source 5 0 does not pass close to optical 
element 62, the size of the visual image is not inhibited 
by optical element 62. 

FIGURE 5 illustrates still another embodiment of 
system 10. As illustrated, this embodiment includes 
image source 50 and magnifying optical element 62 located 
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within dashboard 22 . Additionally, the embodiment uses 
windshield 24 of vehicle 20 as the combiner. 

In operation, image source 50 generates a visual 
image based on the information from an electromagnetic 
radiation collector, such as, for example, radiation 
collector 40. The visual image then propagates from 
image source 50 to magnifying optical element 62, which 
magnifies and redirects the visual image toward 
windshield 24. In particular embodiments, optical 

element 62 may also correct for distortions caused by 
windshield 24. Upon encountering windshield 24, a 

portion of the visual image is directed toward viewing 
location 70 for presentation to the operator of the 
vehicle. As discussed previously, different portions of 
the visual image may be viewed at different viewing 
locations . 

The embodiment illustrated in FIGURE 5 has several 
additional technical features. For example, when 

magnifying optical element 62 is limited by packaging 
constraints or edge effects, a larger FOV and/or 
attenuation of the edge effects may be obtained. As 
another example, using windshield 24 as the combiner 
allows the operator a full FOV when then image system is 
not in use. Additionally, no border effects are present 
at the edge of the image. 

Other embodiments of the invention may use 
combinations of the previously discussed embodiments. 
For example, in some embodiments, the invention may have 
image source 50 and magnifying optical element 62 in 
dashboard 22 and a combiner mounted to dashboard 22 . 
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Moreover, the combiner may itself be a magnifying optical 
element or a non-magnifying optical element, such as, for 



invention is not limited to any particular collection 
and/or arrangement of optical components. 

Furthermore, the present invention is not limited to 
any particular optical parameter, such as, for example, 
look down angle, virtual image distance, f ield-of -view, 
eye to combiner distance, optical element size, and/or 
image source aperture size. For instance, the invention 
may be applicable to systems having a virtual image 
distance between approximately one to one-hundred meters. 

In embodiments using a magnifying optical element, 
the optical element may be designed according to the well 
known Zernike Equations, in which : 



Z,(X,Y) = 1, 

z 2 (x,y)=x, 
z 3 (x,y)=y, 

Z 4 (X,Y)= X A 2 + Y A 2, 

Z 5 (X,Y) = X A 2-Y A 2, 
Z 6 (X,Y) = 2XY, 
Z 7 (X,Y) = x(x a 2 + Y a 2), 
Z 8 (X,Y) = Y(X A 2 + Y A 2), 
Z 9 (X,Y) = x(x a 2-3Y a 2} 
Z 10 (X,Y) = Y(3X A 2-Y A 2), 



example, a flat combiner. 



Accordingly, the present 



z(x,y)=s(x,y)+|; QZ^Y), 
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Z U (X,Y)= (X A 2 + Y A 2)f2, 




Z 12 (X,Y)= X a 4- Y a 4, 




Z ]3 (X,Y)= 2XY(X A 2 + Y A 2) 




Z 14 (X, Y)= X a 4-6X a 2Y a 2 + Y a 4, 




Z 15 (X,Y)= 4XY(x A 2- Y a 2) 




Z 16 (X, Y)= x(x a 2 + Y a 2) a 2, 




Z 17 (X, Y) = y(x a 2 + Y A 2^2, 




Z 18 (X, Y ) = X A 5 - 2X A 3Y A 2 - 3XY A 4, 




Z 19 (X, Y)= 3X a 4Y +2X A 2Y A 3- Y A 5, 




Z 20 (X, Y)= X A 5-10X A 3Y A 2- Y A 5, 




Z 21 (X,Y)= 5X a 4Y -10X A 2Y A 3 + Y a 5, 




Z 22 (X,Y)= (x a 2 + Y a 2)"3, 




Z 23 (X,Y)= (X A 2 + Y A 2) N 4,and 




Z 24 (X,Y)= (x A 2 + Y A 2^5. 




As is well known to those skilled in 


the art, the 


coefficients for these equations may be 


determined by 



specifying the optical parameters for a given optical 
system - such as, for example, look down angle, virtual 
image distance, and eyebox size, which will probably vary 
greatly from system to system - and iterating the 
equations using well known computer programs. 

Figure 6 is a flowchart 600 illustrating a method 
for providing images in accordance with one embodiment of 
the present invention. The method begins at function 
block 604 with collecting electromagnetic radiation in a 
f ield-of -view. The method continues at function block 
608 with generating electrical signals that represent the 
electromagnetic radiation. At function block 612, the 
method calls for generating a visual image based on the 
electrical signals. The method then calls for reflecting 
the visual image with a fold mirror at function block 616 
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and reflecting the visual image with a combiner at 
function block 620. Note that an image display system 
may repeat these operations numerous time per second, 
such as, for example, at a video rate of 30-60 Hz. 

Although Figure 6 illustrates a method for providing 
images in accordance with one embodiment of the present 
invention, other embodiments may have less, more, and/or 
a different arrangement of operations. For example, in 
some embodiments, the visual image may not be reflected 
from a fold mirror before encountering the combiner. As 
another example, in certain embodiments, the visual image 
may be redirected and/or manipulated by any of a variety 
of other optical elements, including the vehicle's 
windshield . 

While the present invention has been described in 
reference to head-up displays (HUDs) - display systems 
where the windshield of the vehicle acts as the combiner 
- and direct view displays - display systems where the 
magnifying optical element acts as the combiner, also 
known as CHUDs - the invention is useful for a variety of 
other types of displays. For example, the invention may 
be useful for virtual image displays (VIDs) - a head-down 
system using a virtual image. Accordingly, the present 
invention is applicable to a wide variety of display 
types. Moreover, while the present invention has been 
described in reference to night vision systems, it may be 
applicable to day vision systems too. 

While the present invention has been described with 
several embodiments, a myriad of changes, variations, 
alterations, transformations, and modifications may be 
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suggested to one skilled in the art, and it is intended 
that the present invention encompass such changes, 
variations, alterations, transformations, and 

modifications as fall within the scope of the appended 
claims . 
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